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■**  The  Naval  Aerospace  Medical  Research  Laboratory  is  studying  the  use  of  cognitive, 
perce ptual^motor,  and  multiple-task  (CPM)  tests  to  predict  aviator  inflight  performance. 
If  successful,  these  tests  may  facilitate  aircrew  selection,  training  pipeline 
assignment,  and  post-training  aircraft  assignment.  The  research  objectives  are  to 
develop  relevant  automated  tasks,  test  them  on  aircrew,  and  then  relate  aircrew  test 
performance  to  actual  inflight  performance.  All  of  these  objectives  depend  on  being 
able  to  identify  reliable  measures  of  inflight  performance. 

In  our  first  study,  18  F-M  pilots  completed  automated  tests  and  then  performed  in 
Fleet  Fighter  ACM  Readiness  exercises.  We  found  that  their  overall  ACM  grade  (OAG), 
resulting  from  the  Tactical  Aircrew  Combat  Training  System  (TACTS)  ACM  performance 
evaluation,  was  significantly  related  to  the  subjective  OAG  measures:  offensive 
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maneuvering,  situational  awareness,  and  mutual  support.  In  addition,  the  OAG  was 
significantly,  but  negatively,  related  to  the  objective  TACTS  measures:  mean  time-to- 
first  kill,  adversary  aircraf missile  shots,  and  the  number  of  tiroes  a  pilot  was 
"killed"  in  the  simulated  exercises.  In  other  words,,  a  higher  ACM  grade  was 
associated  with  shorter  times* tc-first  kill,  being  shot  at  I'.ess  often  by  adversary 
airoraft,  And  being  "killed"  fe  ;er  times.  Statistical,  analysis  indicated  that  four 
ratings /measures  reliatjy  predicted  the  OAG:  situational  awarepess,  offensive 
maneuvering,  number  of  ti.-nes  killed,  and  mutual  support.  ^ <,lx  ■.  '  m*f~  . 

Wo  correlated  the  OAG  and  the  above  four  criterion  measures  with  the  CPM  test 
performance  of  the  F-4  pilots.  A  composite  kill-differenoe  score,  based  on  the  total 
number  of  ACM  kills  minus  the  number  of  times  a  pilot  was  killed,  was  also  analyzed. 

We  found  that  dichotic  listening  test  measures  obtained  during  multiple-task 
performance  were  significantly  related  to  offensive  maneuvering,  OAG,  and  the  kill- 
difference  composite  soore.  Thus,  our  tests  relia  'y  predicted  ACM  performance  for  a 
small  sample  of  F-4  pilots. 

In  a  second  study,  we  examined  the  TACTS  ACM  competitive  performance  of  125  F-14 
naval  aviators  participating  in  Fleet  Fighter  ACM  Readiness  Program  Exeroises  at  NAS 
Ooeana.  Results  indicated  that  a  few  measures— kill-difference  composite  score, 
situational  awareness,  energy  management,  and  mutual  support  measures— could  reliably 
predict  the  OAG.  We  also  analyzed  the  reliability  of  the  Fleet  Fighter  ACM  grading 
process.  Based  on  a  prediction  model  of  OAG,  overall  ACM  Grades  were  computed  for 
eight  different  pilot  subsamples  and  then  correlated  with  the  actual  OAG.  The  mean 
correlation  value  was  .88,  which  indicates  that  the  OAGs  obtained  from  the  prediction 
model  were  highly  similar  to  actual  OAGs,  rsgardless  of  the  subject  sampling  proce¬ 
dure.  From  these  results,  *:e  conolude  that  the  Fleet  Fighter  ACM  Readiness  program 
grades  are  reliable  criteria  for  validating  tests  designed  to  predict  F-14  pilot  ACM 
performance. 

In  a  third  study,  we  computed  correlations  between  TACTS  ACM  criteria  and  pilot 
bxperience  measures  (age  and  type  of  flight  hours).  Mean  time-to-first-kill  soore  was 
consistently  related  to  both  age  and  flight  experience.  Also,  pilot  experience 
influenced  performance  in  TACTS  ACM,  especially  in  achieving  visual  identification 
kills  and  improved  time-to-first  kill  scores.  Neither  pilot  age  nor  flight  experience 
was  related  to  engaged  kill,  number  of  times  killed,  situational  awareness,  visual 
tally,  and  visual  identification  range,  criteria. 

In  conclusion,  the  successful  validation  of  synthetic  tests  to  predict  ACM 
performance  should  be  valuable  for  improving  the  quality  and  capabilities  of  fighter 
aircrew  through  their  initial  selection  and  subsequent  assignment  to  training 
pipelines  and  aircraft. 
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The  Naval  Aerospace  Medloal  Research  Laboratory  is  studying  the  use  of 
cognitive,  perceptual-motor,  and  multiple-task  (CPM)  tests  to  prediot  aviator 
Inflight  performance.  If  suooessful,  these  tests  may  facilitate  aircrew  seleotlon, 
training  pipeline  assignment,  and  post-training  aircraft  assignment.  The  researoh 
objectives  are  to  develop  relevant  automated  tasks,  test  them  on  aircrew,  and  then 
relate  alrorew  test  performance  to  aotual  inflight  performance..  All  of  these 
objectives  depend  on  being  able  to  identify  reliable  measures  of  Inflight 
performance . 

In  our  first  study,  18  F-4  pilots  completed  automated  tests  and  then  performed 
in  Fleet  Fighter  ACM  Readiness  exercises.  We  found  that  their  overall  ACM  grade 
(OAG),  resulting  from  the  Taotloal  Alrorew  Combat  Training  System  (TACTS)  ACM 
performance  evaluation,  was  significantly  related  to  the  subjective  OAG  measures: 
offensive  maneuvering,  situational  awareness,  and  mutual  support.  In  addition,  the 
OAG  was  slgnlfioantly,  but  negatively,  related  to  the  objective  TACTS  measures: 
mean  tlme-to-flrst  kill,  adversary  aircraft  missile  shots,  and  the  number  of  times  a 
pilot  was  "killed"  in  the  simulated  exercises.  In  other  words,  a  higher  ACM  grade 
was  associated  with  shorter  times-to-first  kill,  being  shot  at  less  often  by 
adversary  aircraft,  and  being  "killed"  fewer  times.  Statistical  analysis  indicated 
that  four  ratings /measures  reliably  predicted  the  OAG:  situational  awareness, 
offensive  maneuvering,  number  of  times  killed,  and  mutual  support. 

We  correlated  the  OAG  and  the  above  four  criterion  measures  with  the  CPM  test 
performance  of  the  F-4  pilots.  A  composite  kill-difference  soore,  based  on  the 
total  number  of  ACM  kills  minus  the  number  of  times  a  pilot  was  killed,  was  also 
analyzed.  We  found  that  dlchotio  listening  test  measures  obtained  during  multiple- 
task  performance  were  slgnlfioantly  related  to  offensive  maneuvering,  OAG,  and  the 
kill-difference  composite  soore  Thus,  our  tests  reliably  predicted  ACM  performance 
for  a  small  sample  of  F-v  pilots. 

In  a  seoond  study,  we  examined  the  TACTS  ACM  competitive  performance  of  125  F-14 
naval  aviators  participating  in  Fleet  Fighter  ACM  Readiness  Program  Exeroises  at  NAS 
Oceana.  Results  Indicated  that  a  few  measures — kill-differenoe  composite  score, 
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situational  awareness,  energy  management,  and  mutual  support  measures — could 
reliably  prediot  the  OAG.  We  also  analyzed  the  reliability  of  the  Fleet  Fighter  ACM 
grading  prooess.  Based  on  a  prediction  model  of  OAG,  overall  ACM  Grades  were  com¬ 
puted  for  eight  different  pilot  subsamples  and  then  correlated  with  the  actual  OAG. 
The  mean  correlation  value  was  .88,  which  indicates  that  the  OAGs  obtained  from  the 
prediction  model  were  highly  similar  to  actual  OAGs,  regardless  of  the  subject 
sampling  prcoedure.  From  these  results,  we  conclude  that  the  Fleet  Fighter  ACM 
Readiness  program  g/ades  are  reliable  criteria  for  validating  tests  designed  to 
prediot  F-14  pilot  ACM  performance. 

In  a  third  study,  we  computed  correlations  between  TACTS  ACM  criteria  and  pilot 
experience  measures  (age  and  type  of  flight  hours).  Mean  time-to-first-kill  soore 
was  consistently  related  to  both  age  and  flight  experience.  Also,  pilot  experience 
influenoed  performance  in  TACTS  ACM,  especially  in  achieving  visual  identification 
kills  and  improved  time-to-first  kill  scores.  Neither  pilot  age  nor  flight 
experience  was  related  to  engaged  kill,  number  of  times  killed,  situational 
awareness,  visual  tally,  and  visual  identification  range,  oriteria. 

In  oonoluslon,  the  successful  validation  of  synthetic  tests  to  prediot  ACM 
performance  should  be  valuable  for  improving  the  quality  and  capabilities  of  fighter 
alrorew  through  their  initial  selection  and  subsequent  assignment  to  training 
pipelines  and  airoraft. 
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